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ABSTRACT we . 

en the Secondary Prograa for the Handicapped perforas 
wocationel evaluations. on secondary handicapped students in order to 
iaprove their programming by saking their education sore televant to 
future jobs. Extensive improvesent in instructional prograaaing was 
achieved. for one-third of the students served, with sodest benefits 
for another third, and negligible effects for the last third. These 
benefits were liaited by factors external to the Vocational 
Evalnuation Center. For three of five districts studied, iaportant 
apinoff effects on the secoidary school special education prograa 
were identified. Edacators discussed the vocational evaluation 
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denonstrated continuous isprovements in its procedures; conducted 
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FUND:  240-25-6399.01-851 ' Special Education. . : 

DATE: June 20, 1980 ; : Secondary Programming for the Handicapped — 
SUMMARY OF EVALUATION ON THE ACCOMPLISHMENT OF 
OBJECTIVES FOR SECONDARY PROGRAMMING FOR THE HANDICAPPED 

» The purpeses of the Secondary Program for the Handicapped are described on < 
the Program Description page below. The program performs vocational evalua- 
tions on secondary ‘fhandicapped students. As 2 result of the vocational, o 


evaluations these students were to experience fimprovements in their programming, 
particularly making their education more relevant to future jobs. 

All of the evaluation questions, data, memoranda,. and reports have been grouped 
by the objective to which they pertain and are attached. 


The Senior Evaluation Manager believes thists an exemplary project. Besides 
achieving its objectives, it has demonstrated continuous improvements in its 
procedures; conducted outreach. activities to ESC-20 LEA's and other state, and 
regional agencies; 2nd performed for over 100 students group-based prevoca- 
tional skills screenings.- However, most importantly, it has had a major 
impact on the instructional programming for about one-third of the students 
served. The magnitude of these effects is far beyond the typical project. 
ESC-20 and TEA need to find a way to change this year-to-year funded pro- 
ject into an ongoing funded program of ESC-20. t Z 


The major findings of the project are as follows: = 
_»y Objective 1. This’ objective calls for 24 handicapped students to receive a 
. comprehensive and complete vocational evaluation. The objective 
was achieved by early January; by May 23rd, 44 students received 
vocational evaluations. Students pending evaluation will bring © 
the final number to about 50. - _ 
Sixty percent of the students served were Learning Disabled; \, 
L a eighteen percent were Emotionally Disturbed. Other eligibil- 
. ities accounted for about ten peccenc or less of the’ cases. 


Evaluation Services contracted with an external vocational 
evaluation expert from the Center for Rehabilitation Studies at - 
North Texas State University. The external expert, project 
‘staff, and Evaluation Services developed an instrument to assess 
the comprehensiveness and completeness of vocational evaluation 
reports, All sampled reports were judged comprehensive and 
complete by the expert. Furthermore, comments from readers 
interviewed by Evaluation Services corroborated the expert's 
judgment (e.g., "Boy, there #8 a picture of ! Now we. 
see why he acts that’ way,"). - . 


7 Objective 2. This objective requires a minimim of 16 handicapped students to 
have an Individual Educational Program (IEP) developed recom- 
mending specific programs as instructional options. Based on 
intensive interviews, Evaluation Services estimates 44% of 50 
cases, cr 22 students will have IEPS so developed. 

: ie 


Objective 3. A manual containing information on the program was eaited for in . 
this objective, The TEA monitor suggested delaying dissemination 
. of the manual.-because the state had yet to make a number of — 
decisions about vécatione! evaluations. For this reason evaluation « 
resources were redirected to other work, 


Additional Evaluation Support: : 


(1) Developing and clarifying several sets of program objectives. 
(2) Keypunching - ‘and producing statistical analyses of test data. 


, (3) Analyzing and reporting needs assessment data on Job 
: Analysis. rae 


(4) Evaluating,several workshops related to the program. 
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PPOGRAM DESCRIPTION 
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’ Given the Education of All Handicapped Children Act (P,L. 94-142), the t 


: tion allowing trem to participate meaningfully in society. 
° g ‘ : 


.and a .65 FTE Project Manager. It is housed in a Vocational Evaluation Center - ~ 


— 


vocational education subpart of the Education Amendments of 1976 (P.L. 94-482), 
and the Rehabilitation Act of 1973 (P.L. 93-112, sections 503 ae 504) a man- — 
date exists "for total participation of handicapped persons in ociety" (pro- 

posal, pg. 8}. Needs assessment data collected in Region 20 established voca-" 
tional preparation, especially for secondary special education students, as a °_ 
high need. ESC-20 submitted and received funding for two projects to ensure | 
the education of secondary handicapped children results in vocational prepara- 


. 


This $56,985 ESEA, Title IV-C program employs a full time Vocational Evaluator 


(classrooms located at Woodridge Elementary School). The center contains the © 
VIEWS (16 work sample assessments correlated to the DOT), two VALPAR work sam 
‘ples, Project Discovery-(aboyt eight simulated job samples), Tool Tech, and In- 
terest inventories. These resources are used to conduct the following activities: 


Information Dissemination ee __ ode 
. Brochures : d letters sent to, LEAs asking for potential cliencs 
> Visits to LEA's lea#fning about their-ARD/IEP process and explaining 
project ‘ 7 - 
. Meetings at Woodridge introducing facility to LEA staff 
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Vocational Evaluation : : 
. Initial visit with LEA diagnostician or vocational counselor present 
. Assessment lasting anywhere from 4 day to as much as 6-8 days 
. Report writing ; ers : # 
Facilitating use of vocation,evaluation reports : , 
. Debriefing LEA persbnnel : . ’ 
. Project Manager's work with LEA personnel ~— . 


The product that resul-s from these activities is a- Vocational Evaluation Report 
specifying, among other things, student interests, work sample results, resul‘s 
of manual dexterity and-motor coordination tests, knowledge of tool use, and 
behavioral observations. The report would also recommend prevocational needs 

to be addressed and appropriate placements. Another product is the closer 
working relationships among all LEA persons involved in the ARD/IE” process, 
especially the.diagnosticiam and vocational counselor. , 


The specific objectives of ihe.project are to provid> 24 students with com- . 
prehensive vocational evaluations, enable at least 16 of these 24 to have 
improved instructional options, and to disseminate a manual to tell other 
LEAs how ESC-20 did it. A longer range goal would be to establish a cost- 
effective vocational evaluation center. .- = = = 


- ACTION 


~ IMPACT ON STUDENTS , 
A. We estimate éxtensive*improvement} in instructional 
° programing. for one-third of the students served. The 
case reports document a substantial pervasive change 
sin these students’ “instructional program which will 
tbetter nieet their post-schooling needs. We found 
. quite modest benefits to another one-third of the < 
-  gtudents and negligible effects in the last third. 
These findings were based. on interviews covering the 
use of vocational evaluation reports for a represen- 
tative group of students. _ z 
. 17 


The findings suggest the project worked well. -Howeve 
to inerease the péreentage of cases with extensive ~ 
improvement in instructional programming two actions 
are being taken.. The Intake Form will require the _ 
name of vocational personnel to whom a copy of appro- 
priate reports can be sent. This will increase .the 

number of advocates for appropriate programming. Alt 
referrals will only be taken from districts with ade- 
quate knowledge of the students’ prevocational skill: 
thus increasing the likelihood of impacting students 


B. The benefit to students is limited. by factors 
. external to the Vocational Evaluation Cente., These 
include,~but are not limited to, Local Education 
Agency (LEAs) existing personnel and programs, the  , 
- attitudes and behaviors of students, and the 
students’ family situation.  ~ = 


e 


Project Staff will be concentrating on LEA factors 
which they can affect. A three-pronged approach is 
planned. First, project staff will be attempting to 
upgrade the skills of LEA personnel by teaching them 
to do prevocational screening (Level I assessments) 
and certain-worksample assessments, Second, project 
staff will be focusing project activities to’ some 
extent on LEAs having the ‘prerequisites to utilize 
" vocational evaluations or having the interest to gal 
_ ae rer oe ots ir oe these skills. Third, project staff will be attendin 
; = 7 -—nore-Admission-Review-Dismissal Committees (see D. 
: below) where they will be able té be mort active in 
promoting appropriate use of the reports. All three 
approaches have potential for overcoming limitations 


9. 


@ - | | 
ERIC#® means concrete policy, procedures, decisions,* or assignments. 


“=RO action" may be juctified but should be explained ‘for the record. ; & 


SS _— USING EVALUATION. DATA * ee ee 


FINDINGS 


“IMPACT ON EDUCATORS 


2 We For: shee of five districts studied imporfant 
, 7 spinoff effects on the secondary special education 
4 rogram were identified. In the ‘judgment-of the - 
=> Senior Evaluation Manager these effects are poten- . 
- tially as important as the direct effects on students. 


* 


= . ? : ' 
Projec. staff see chemselves continuing their general © 
consultative assistance role ta teachers, LEAs, ESCs, . 
and the state, They even made consultative assistance : 
to model high schools the subject of a Title Iv-¢ ae 
proposal. However, this proposal was not submitted s 


# .- For examplé, one :high.gchool is planning to change, the this year. ~ ere 
~~. _. geeondary curriculum: to a functional skills curriculum |» - ~~~ , : : os . oe 
“ as a pilot project. Los . mE a , : 
a q 5 . F e. ¢5 
4 : ° : ~ ss f ; “ : ; 
7 ; ; of 
a Ao ; ‘ we; 
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Many educators were reported to have ‘discussed 7 
the reports, Readers were very impressed with 


The vocational evaluation report format will be “ | ae: 
modified to-state the day(s) of week and hours the ~- a8 
the reports. The only possible area for improve- - Yocational Evaluators will be available for Admission here 
ment might be debriefing. . -~ - | . Review Dismissal Committees (e.g., M, F 3<5 poms}e -. - - 
: es This will be an opportunity. for the evaluators to . 
7 3 ra _ debrief appropriate persons on the data gathered, - . 
_ o Oo \ AS ie - observations incidental.to'the evaluation, and inter- i, 8 
; - : cd _pretations/implications for the students' program. i 
, : + Project staff state debriefing of whomever accom- |, 
panies-the student and, often, the student occurs : 
while the student 1s being tested. : ‘ 
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Action means concrete policy, procedures, decisions, or assignments. 
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ING EVAUATION DAA 


QUALITY OF. THE REPORTS 


E. All ine reports met the criterion of comprehen-_ 
siveness and completeness as judged by the So . 
The only saprovencnt in reporting 
suggested by the experts’ ratings, was eee 
.-@ specific reason, for the referral and. perhaps: tore 
. (or, more clearly presented) ‘background data. , 


TH PRODUCTION OF THE REPORTS 


-F, jhe prqject had evaluated 44 students ‘ab. £ May -23rd, 
1980; by June 30th more than twice the number speci- 
fied -in the objective will be served. 
number of hours to produce a Vocational Evaluation 
Report has dropped from’ about 23 hours to 12.5 

hours (cases evaluated after December). 
assistance renfains a small percentage of case time. 


Consultative 


> 
= : . 


~~ Activity. Percentage” 
Set-up/Takedowy ° ; _ 

_ Consultative Assistance 
Direct Service 


Analysis & Report. Writing 


“action means concrete policy, procedures, éécisionss or assignments. 
tetion". may be justified but should be explained | for the meeone 


. ; : . me a a 
‘Project staff have revised-the Intake Form, Bas{c 
"; $kills Checklist, ‘and Behavior Rating Seale to lead 
to clearer réaspns for referral and more clearly « 
presented background datac : 


*.. ae . a 
. bh a : . 
Project staff report follow-up consultative assistance 
is only possible for Lével II assessments (assessing: 
potential for, vocational~programming) . ufthermore, 
follow-up ‘consultative\assistance (1) can alienate 

- school district pergonnel if it is too. directive, and 
(2) is ‘unnecessary since many cases are referred more 
- to meet the requirements for.a vocattonal evaluation 

, shan to effect program placement. - 2 * 
pokecheianes two actious are plarthed. Thg number of 
referrals not accepted will bé increased to maximize 
the potential impact of the reports. ‘Second, project 
staff will do.a telephone fotlge- up about 3-6 weeks, ' © 
after reléasing the'report to see tf there t& any | 
consultative assistance. they can provide the districts 
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* STUDENTS SERVED 


™ 


_ "6. The students served in this project this year were 
el as & about 60% Learning Disabled and 18% Emotionally 

7 _ Disturbed with other elgibilities accounting for 
relatively small percentages. 
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Project staff stated a project goal was to evaluate higher’... 
functioning 3tudents who had a potential for independent - 
living and job placement. This resulted in referrals of 
~ Learning Disabled and: Emotionally Disturbed students. ~—. 
Project staff would like to increase the number of higher _: 
functioning Mentally Retarded students served, bat no. ° : 
action is planned 4t this time., aoe fs 
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Project staff plan.to increase the proportion of 15-and— — - 
16 year-olds served. They have designed a letter and a ; 
brochu. 2 describing their services which emphasizes these 


Their ages were distributéd as follows: . 


_ 2 — Cea nc eee et SaeEnenaeaEEE nnn" iin id = —— 
Sy “AGE - Percentage 


_Yess than 15.0 14% . aad * 2 
Soi COLE Oe 8 0 aaa os eee Be % 
= _ 17,0? ox more 52% as : : 
a s = = so’ * Said x ° ce a 
=" ani , iz aan lina e ‘ : aaa ; 7 - $ES vee, Stel 
7 I. pistricts ‘gerved (data frem both** Projects) were: np action planned. 7 
7 . “Dratefee_ 7 ws 2 
"3, Bexar County (64) _ . : 
“ _ WEIESD 1 > 
7 wisp : NY ; ‘ - 
~— BSB ; a r = e ‘ ° 
_ aMIsD 6 > . ee 7 e 
s ‘ Lackiand ISD a a aie __ 
.* SALSD . Pa ee 
Fe, Sam ISD ° 3 . 7 
‘ “ggiso : 2 _ = oP 
Rar landale : j a ae ee 
cle Men-Bexar County - ey) ee : : 
fagle Tass ISD ‘ ih ~)._ “yes ve 
Sabinal ISD 7 8 re é , 
: > Bracketville ISD t *. ° 
cc Kerrville ISD P 4 > rf 
. : . Out-of-region 1SD's ? : a 
rs s Medina 130 : Poe ee . “as : 
_\Action means conc. éte policy, procedures; decisions, ‘or assignments. ~ a: OO ‘ . a 
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RIC other program funded by TEA's Division of Occupatio-xal Education and Technology. with public Law 94-482, 
am=satle II, Vocational Education gonies also supported similar purposes as this project i 


‘9° "No" action" may’ be justified but should be explained for the record. 
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PROGRAM OBJECTIVE 1 


By May 30, 1980, a minimum of twenty-four handicapped 
students representing schools participating in the first 


‘ and second years of the Model for Planning and Coordi- 


ee 


the nating a Comprehensive Educational Program for Second- . 


ary Handicapped Students will have received a compre- 
nensive vocational evaluation (see Appendix VIII for 
data’to be included in report). Accomplishment of this 


opjective will be evidenced- by an external vocational 


evaluator judging the Vocational’ Evaluation as ‘compre- 


hensive and complete. 


WiLL a minimen of 24 handicapped students receive .comprehenstive 
vocational 2valuations? : 
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Distribution Statistics 


The 44 students evaluated as of May 26, 1980 were distributed by eligibility 
and age as follows: 


Eligibility N Age ON 

Lb. 26 . 13.0 - 14.11 6 

‘ . ED 8 15.0 - 16.11 15 

MK 5.5 17.0 - 18.11 22 

a Other 4.5 19.0 + l 
: TOTAL 44 TOTAL 44 


The 96 Students evaluated as of May 26, 1980 by both this Title IV-C and the 


vocational education project in.the file on May 26, 1980 were distributed by 
LEA as follows: : 
“District CSN 
Bexar County ~— nn €.19) _ 
NEISD 18 
NISD 18 
- EISD a, ; 
AHISD 6 
Lackland ISD 4 - 
eee ee SAISD 4 ‘ 
Fev Sam ISD . Se <s - 
- ECISD 2 <= ssa tee _ 
Har landale 2 
Non-Bexar County (32) 
Eagle Pass ISD . ll : 2 St Bee? ig Stel 
Sabinal ISD : 8 . | 
a Bracketville ISD 6 , 
Kerrvi._le ISD -—- © & 
Out-of-region ISD's 2 ee 
Medina ISD 
. a 
Q ‘ 
ang 
é 
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BQ 2. How many hours per week, on the average are vocational evaluators 
providing assessment service? 


Vocational evaluators are providing about 24 hours per week. This answer is 
based on a 28-week period from the week of 9/3/79 to 3/31/80, excluding the weeks 
of 11/19, 12/24, and 3/17. Because the figures for the two projects (this 

one funded by Title IV-C and the second ane funded by- Vocational Education) 

are so close, one estimate founded to the nearest .5 hour/wk. is given: 


Nature of Task Hours Per Week 


o Assessment Service = - - 7 
Data analysis-&-report-writing ..._ . __10,08__ : 
Direct Service (#.e. testing) 7.5 
"+ Consultant visits 3.5 . | 
Workshop presentations _ 2.5 
Set-up/Take down 1.04 
Other 
Building a Vocational Evaluation Center 10.0 a,b : 
__. Travel | oe . - 2.00 
Staff development oo "1.0 
Center staff meetings : ss 1.0 
< ~—beave Cests)}—--- -—------ — -- _. eae 
o 
NOTE 


a These three figures are a breakdown ofthe preparation hours 
in Raw Data Table 4 below given the data from Raw Data Tables 
I and 2. 
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b-This includes- setting up the physical building and materials, 
reviewing materials, writing and modifying procedures, etc., 
that is, all the developmental work necessary. 


c This is a very gross estimate obtained by subtracting the 
total of all other estimates from ‘40 hours per week. 


N Set-up/ Consultative Direct Analysis & 
Take down Assistance ~Service Report Writing 


Project 


a Average © 


However, this average is not descriptive of the Vocational Evaluation Center, 
as thié comparison between the-14 cases evaluated prior to November with the 
13 cases begun after December is the sample of 61 shows. 
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Average Hours Per Case for Two Samples" 


‘ t 


Set-up/” Consultative Direct Analysis & Total 
Take down Assistance Service Report Writing 
| i 
ae 7 — eee 
Prior to Nov. | 14 1.6 1.3 7,8 12.3 ; 23.0 


Post Dec. 13 0.6 0.0 4.7 7.3 - 12.5 
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ae the standard set prior to review; our Vocational Evaluation Reports 
—---——-a#@-judged to be comprehensive and complete. The Report Review Form (see : 


EsQ> 3--- Have-our_reperte met the ertteria of comprehensiveness and 
’ gompleteness?. What are—the-recommendations of an external 
expert (see contract above) fer improving the vocational 

evaluation reports...? a 


- . i * 


- 


copy below) specifies nine criteria, —The. standard set prior to review - 
was seven of.nine criteria’ receiving ratings of "4" or “5'-indicated that 
report was comprehensive and complete. All nine reports rated met this. ~~ --~ — 


standard. 


The comments and ratings on the individual reports suggest one improvement 
is possible. This improvement, however, relates more to LEA responsibilities 

_ than Vocational Evaluation Center responsibilities -- clear presentation of 
available background data, including a specific referring questions. The 
judgment of Evaluation Services is that the possible problem in this area is - 
lack of information and vague reasons for referral presented by the student's 


--districts. 


ey 2 


Kay McAllen be Phone No. (81/) 7882488 X2218 
as Center for Rehabilitation Studies ~ SSN: ats - 66-9475 
~~ NT Box 13438, aa ' 
“ Ntsuy 


Denton, Texas 76203 | 


~ 


Education Service Center, Region 20, agrees to contract with you to: 


&, 9 


~ ~"~--€1)__Reimburse up to $80.00 in travel and expenses related to your visit.on ‘ 
oa Dec ember17, 1979 to our vocational evaluation center when we receive 
: copies of your receipts (see Administrative Procedure 4.1.19c attached) 
and a list of approximately ten criteria for operationalizing the words 
“comprehensive” and complete" when applied to ESC-20 vocational evalua- _ 
- tions reports. The criteria may include such items as: 


ro a“ 


2 


- The report adequately covers the referring question: 
Strongly Disagree Disagréé-* Neutral Agree Strongly Agree 
«” The tests selected were appropriate to the referring question _ 
and student 
- The recommeadations were based on valid inferences from the data 28 
- The recommendations were complete : 


o 
ia. (2) _ At a mutually agreeable date (March to May, 1980) apply the developed 
: criteria-to -a_random sample of eight reports of our Vocational Evalua- 
. tion Center to judge if they meet the criteria. This work can be done 
7 at your home, The product of this work would. be a rating of each report 
or each criteria and sumaary recommendations. . ; -- er 
- ~-Upon receipt of your ratings of each report on the developed criteria, 
| ESC-20 agrees to pay you the sum of $80.00. = 


This contract. is subject to cancellation by either party with payment prorated 
on the basis of hours worked, : mo a 


: je] re 
Edutation Service Center, “Region 20 
Coordinator of Evaluation Services 

"Alan: Roecks . 
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> Date 
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Educettun Wt irvice Cente ‘bpex fal bducatsan 
ton 20 : & Evaluation Setwlcest 
aa REPORT KEVIEW PORK 
iy 1 ~ 
\ Case ¢ . 3 
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Pukrose: Rete compreheneivenses end completenese of Vucetions! Eveluacion keports end ducument =~ 
1 racommendetions of en externa) expert for improving the vocetione]) eveluetion reporter 


INSIKMCTIONS; Read the report rating each report sxeinet“the criterie by circling the epprepriate, 
= 7 number. Add cvmmente to document recomendations Tur iaprovement.~ Supporting 
ducumentation should include copise of LEA supplied bikeretal dete (item 1), copy 
of checkliet of procedures used (l¢am 4), 1iet of evaileble wosk semplee (item 5), 
and copy of “Appendix A“ notes (lrem 6), « a 


iy : * Ls) RATING SCALE. beyree to which {tem cherecterizes thie report 
_ . -3 2 3 4 5 : 
‘ Herdly et sll » A little Half & Half Most ly Almost completely 
——- ieee j SRE Se ceed coed csceeeeteee ates Se ws ee ee 
% 1, Clearly presente the svellable background dete. 1- 2 .3 4 5 
: 7 - Comment’ . 
2 . See ene. Cee Lars es Ie SR eS SE SE ee he 
ty y 2 wt fe er a a = « 
| , - SS hie eo ree enters 
-4 = 
. . 2 Identiff_ee specific career Swerenessee end intereste, ? 1 2 3 4 5 e 
a Comment 2s 
ee i oe e vd 
ss 
ee ee 
3 Defines prevocetione] ekille mastered and neéding mastery. Hy 2 3 4 5 < 
Comment oe sh ay ie ea a Meee ee oe Be 
’ 3 ote tele eee, Sees = te eS SS 
s > 
a » Se Some ey 2 nee eee ast ma - ene et ' b | 
’ 4 Uses appropriate assessment procedures relative to 2 end 3 1 2 3° 4 5 
+ above. : 
Comment: 
io - . 
> = 
—— eri ~ 
iz 2 $ Given cereer interests and prevocational skills, selects 1 2° 3 4, 8 
appropriste work semplee from those eveilable (eer list). 
. as Comment: seas = - a eas . 
> oe 
6. Vocetionel Evaluation section presents valid inferences . 1 2 3 4 5 
from the date obteined. : . 
- Comment: 2 es ee se ff. ig 
~ if x . 
a ec Bs ok ace et so ee 
‘ 
7. Includes ueeful abservetions incidente] to testing. 1 2 3 4 5 
Comment: EAI Ree e = ee, ete 2 par 
. : ‘ . . + 
5 ° Rae eg dtgee ee ee NS  e e : 
7 8 Sumnary/recommendstions answer the referring question end/ 1 2 3° 4 5 
\ ‘or the reeds of the student evidenced in the dste. , ie 3 eed 
2 Comments | Seats 2 eae Rn een rae Ne z . : 
, ‘6 * * 
- -- ae wie -- = we ee ee ee ee -_ - * 
, a : a 
a 3 
: 9, Reconmendetions potentially ueeful to LEA enncerning: plece- 1 2 3 4 5 . a. : . 
ment, IEP development, or job treining. ‘a . 
Comment* . 
a eee ee ee ee ee ee aioe cau patel a a? 
i ’ a a 
6 eerse dS preteen aed oe a oc eee: wee ara 
’ _ Pe er nen mene ee ie ie Te ~ ces: 7 : 
. 2 
2 : x ; ; ; 
. * 
o s e 2 
. 
* a 
. rt 2 
ed . 
‘ at be J 2 “ . 
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~ Realy to , 4 
oe Center for Rehabilitation Studies : 
' PO Box 1.438, NTS ; 
Denton, Texas 76203 : | 
~~ a; 
\ 
North Texas | 
State . a 
‘ 7 University ff 
£ a é . Reston Vaaee i 
> Denton, Texas f 
ete OTe oe, ce ones ave . nt 76203 
Center for 
an Fe Rehabilitation 
: Studies 
Mr. Stan Drezek : — : 817-788-2488. 
Senior, Evaluation Manager -2 : P . AC 817-788 2218. 
Region 20 o , . oe 
Educ..ional Service Center = ‘ ; . : 
1550 N.E. Loop 410 ; ; 
San Antonio, Texas 78209 : : 
' - ° : 
* Dear Stan, : . . eo. 
. z z ee ‘ 
Lnclosed are we eview forms which will complete our contract. Not : 
’ being sure if this was to be a blind review, I numbered the, review forms. 
I have enclosed a list of names and riumbers in case yo: want to evaluate 
_ specific reports. : = a ' 
7 : “1 have enjoyed working with you on this project. Basically, the reports 
. were well written and very specific. : 
= Sincerely, ig ‘ > 
Kay Lh Weather . gh 4 - 
Kay Ri McAllen : ° * . 
Associate Director ‘ , , 
Center for Rehabilitation Studies. if 
KRM/ms , ss . 
va 
Encls. ° . ; 


cf etat huh service Centar * byectal kducation 
, pegten 20 = Evaluation Services | 
REYOUT aAEVIEW FORK 
Case @ ig 


PURPOSE: ate compraheneivenees and completenase of Vocetione) Evaluation Ksporte end document 
fecomandations of an axterne] expert for improving the vocetionel eveluetton reporte. 


MWSTRUCTIONS; Read the report. rating sech Feport egeinet the criterie by circling the appropriate & 


number. Add comments to document recommendations for improvement. Support ing 
documentation should inc. « copies of LEA guppliad background dete (ltes 1), copy 
of checkliat of procedures ueed (Item 4),~ Met of avetteble work semples (tes 5), 
and copy of “Appendix A” notes (Item 6), 


i ° 


RATING SCALE: Degree to which item cheracterizea this report 


| 2 2 3 . 4 ; 5 

Mardly at e11 A little Half & Half Moatly Almost completely 

1, Clearly preaenta the available background dete. : Nr oo} 2 3 4 5 
Comment: have not very com ciete My / HW! 

V_Site com gl 2 rT ae A . 
+ eekWes “ N ee a 
~~ = <a. iT) a i apie roy eerie a ay KH Awe 
_ ae weer ast ry Scat we Aven \. dee . 
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2. Identiffes apecifie career everenesses and intereate, 1 2 3 4 5 
Comentz _. 5 Y 4 Wy 
eat eis a aes ota, meee ae eee es 3 “ary 

come, 4 Set ees eee hay sarees S 

3, Defines prevocational' akille mastered and needing mastery. 1 2 3 4 5 

Comment: = Sa ee bhi 
‘ Ko $0 Y/ 
a er eee, een 

4 Uses appropriate ansessment procedures relative to 2 and 3 1 2 3 +4 5 
above, Laden Bee EOS 
Coment: _very_s¢ aod Be a AMU{}| 

ehan A evade x7 50 
Ee en Pe. ee a rene ee peels 

§. Given career “tnteresce aod prevocetional ekille, selects - el 2 3 4 5 
appropriste work say dae Hag shone avatleble (see liet). / / ty 
Comment : Sect aleve ido ost adanuster as _! My 

weed Sage Se ar peel” ante. 1c) PY . y Albeo 
te eee 1O re Shia ee ees ‘ 
Site pee A i, ve 
&. Vocatidnal Evaluation section presenta valid inferences 1 2 3 4 by 
oa Ren tuple gt the etek we WAG the dete / Wy We 
te ren Ste eet = - 
Se tds atk te ee cc 7 . * 45 
pe | aid sorters 
wwe d waste TMS RTT Od Myles aw woulear 
7, Includes useful observiigns incidental to tegt ing: 4. 1 2 3 4 5 
Comment : cover 4 ewetions uaseides ,ocd 
1___ aaah aims Leet ies “| 
ask de alee Ns ¢ Sales 
epee) Ppa, 2 a , si aia ie . 5 = 
“ /. . . 
: 8. Sumary/recommendationa answer the referring question and/ vy 2 43 4 5 
or tve needa of the atddent dees in the By ayies eoenen Ge velanl) “4 4 
Comment: oA Mea sot vk ned ge Sa Nan tn bode dette, - “by 
acing a coal mh avant! preg ATH eT ee nt 4.72 
_ shave’ Teummn neh acudenus 


SSeS esis STA Sheet Tet tee 


s yeh. Wi atomees t 
RE STN eae eS Mes : 
abheare. RSS cteden% 
9. Recommendations potentially useful (> LEA concerning: plece- 1 2 3 4 5 
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EDUCATION SERVICE CENTER, REGION 20 


EVALUATION SERVICES MEMORANDUM 


x 
ITLE: Interim Report: (Title Iv-C) Secondary Programming for 


the Handicapped 
PERSON PREPARING: | Stan Drezek 


DATE: . January 28, 1980 ° ‘ 
DOCUMENT NUMBER: 79:217 ° 


Note. Attachments | to & deleted Grom *hiS Erma ve port bas WY 


Background 


Secondary Programming for the Handicapped has three objectives: (obj. 1° per- 
forming 24 comprehensive vocational evaluations, (obj. 2) 16 of the, 24 students 
having improved instructional options as a result of the vocational evaluations, 
and (obj. 3) developing and disseminating a manual on the program. Object ives 
2 and 3 are Spring 1980 activities 2 i therefore not addressed in this interim 
report which covers“the first two project quarters (through December 31, 1979). 


Results 


The Using Evaluation Data pages below provide the key findings from the evalua-~ 
tion questions (next section) and attachments cited (last section). Accompanying 
these findings are the interim actions planned by project staff. 


SD/ds 


” « \ 


ec: Arturo Luis Gutierrez 
Alan Roecks 
Patti Myers ‘ 
Jane Francis » 
Dorothy Cox, TEA.Monitor (c/o Jan. Francis) 
Tom Toleman , 
Tom Sanford 
Stan Drezek (Project Fies) 


ee 


USING EVALUATION DATA Ss 


rte 


¢ 


ACTION 


%, 


Project staff plan to utilize the identified available 
time to (a) meet request for workshops, consultations, 
and additional assessments and (b) perform prevoca-~ 
tional assessments on over 100 SAISD EMR 9th graders 
as’ a pilot effort to begin moving prevocational 
assessment into the schools. (Note: prevocsiional - 
assessment correlates with Level III of AD-8~87 1-01 
(criterion measures) )-: 


“Based on a cumulative graph of reports completed each 
month, *t the end of February (4 months early) .the 
required 24 evaluations will be completed allowing 
additional resources for comple. ‘ng the manual 
(objective 3), doing more evaluations, or other 
-work the project staff deems necessary. 


tk 


3 9 

Given the extremely high amount of service that 
this project provides, project staff plans to discuss 
with the Coordinator of Special Education (a) ways to 
communicaté ‘to the Texas Education Agency that this is 
not just “another IV-C" but a unique contribution -to 
secondary special education in the state (b) the role 
of ‘vocational evaluator’ should not necessarily imply 
separate certification as stated in the Policies and 
Administrative Procedures for the Education of Handi- 
capped Children (c) staff for vocational evaluation 
should be provided from SB-350 monies <as part of the 
appraisal] process and PL 94-142 monies for serving , 
the underserved in secondary special education in 
public schools. 


Twenty-six hours per week in assessment service 

could be documented to specific students. Another 
four hours per week in consultations and workshops 

is estimated. : : ; 


= 4E = 


* | ! 
Action means concrete policy, procedures, decisions, or assignments. 


"No action" may be justified but should be explained for the record. 

9 na. 3 Ji 
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USING EVALUATION DATA 


e 


FINDINGS yi ACTION 


Given-‘the data and their exveriences. Project staff 
have decided "complete and comprehensive" assessments 
need to be done over the course of a four year second- 
ary program. They are working on (a) determining what 
the ratio of assessment types ought to be-~ Level I: 
Level II: Level III. (Note: levels refer to level 
of vocational assessment--these levels are all Level 
III of AD-8-871-01). 
Level 1: prevocational skills and career 
awareness ; 
Level II: assessing potential for success in 
vocational programs 
Level III: work samples preparatory to jobs 
(b) moving Level I assessments into the sthools, and 
(c) developing specific objectives for the funded 
and proposed projects which would be complementary. 


From preparation to final typing---not necessarily 
including all follow-up consultations, an average 
comprehensive vocational evaluation takes about 16 
hours. 


Project staff anticipate the Level of assessments 

done in Spring 1980 will influence these ratios. Most 
important in reducing the cost/student will be working 
with the schools to focus the referring question and 
level of vocational assessment needed. 


- ° Fifty-eight percent of the time per case is spent in 
report writing.* Other percentages are: 


| Set-up/take down "6% 
Consultation 2% 
Testing 34% 


,includes data collation,interpretation, writing the 
ceport, and proofing/revising. 


action means concrete policy, procedures, decisions, or assignments. 


“No action" may be justified but shou'd be explained for the record. a Q2 


ERIC 3 2 , we 


7 | | USING EVALUATION DATA 


FINDINGS 


A set of criteria operationalizing the "comprehen- No action n&cessary. 


siveness and completeness" of the finished reports 
was successfully developed by, Evaluation Services, 
project staff, and an outside consultant. 


“ 


x 
Action means concrete policy, procedures, decisions, or assignments. })~ 3 a 


° "No action" may be justified but should be explained for the record 


ERIC 3: 


EQ to . 


EQ 2(b) 


Evaluation Plan 


* An evaluation plan was cooperatively developed by Evaluation 


Services and project staff during September, This plan guides 
our evaluation effort. (Plan attached to TEA monitor copy. only). 


. Will a minimum cf 24 handicapped students receive comprehensive 


vocational evaluations? 


By the end of the first two quarters exactly 24 students had 
alreddy been tested for their comprehensive vocaticzal evalua- 
tions. . Fourteen of these students had completed reports 
(written and typed). The remaining ten reports were in various 
stages of completion from awaiting typing to needing to be 


_written as of the first week in January. (See attachment 1). 


How mahy hours per week, on the average, are vocational evaluators 
providing assessment service...? 


During the first quarter of this project (through September 30) 


the project was in a "setting up” phase. Approximately one-third 
of staff time was in providing assessment service or work- 
shaps and consultation related to assessment service. The 
remaining two-thirds of staff’ time was involved in setting up 

and administering the Vocational Evaluation Center. (See 
Attachments 2 and 3). 


The second quarter was very different--the bulk of time was A 
felated to providing vocational evaluations. Attachment 4 presents 
a'’sample copy of our data collection form for recording hours. 


‘per case. This project provided 308 hours of service across the 


24 cases in the second quarter. © (This is virtually identical 
to 314 hours provided by the other similar project funded by 
Vocational Evaluation). For the twelve week period a minimum 
of approximately 26 hours per week in providing assessment 
could be documented to specific students. 


This figure does not include an estimated four hours per week in 


consultative assistance or workshops not specific to individual 


students; sor is it adjusted for vacation days and staft meetings. 
..-broken down into set-up/take down, consultative assistance, 
direct service, and report writing?* 


For the 14 cases with vocational evaluation reports completed 


in the second quarter the average case received more than 16 
hours of service. 


x 


* Report writing includes data collation, interpretation, writing the 
report, and proofing/revising. é 


aon 


cea aie 


oe + 


Table 1. Total hours of, services for 14 <ases completed by Second Quarter. 


‘Hours of Service (N#14) 
(To nearest hour) 


Percent of 
Total Service (N=14) 


pe of Service 


Set~-up/take-down/travel 6% Sogn 7 
Consultation 22 
Direct Service 34% 


Report Writing 


EQ 3 Have-our reports met the criteria of comprehensiveness and 
. completeness? 


Evaluation Servi -s-has contracted with consultant Kay McAllen 
from NTSU's Center for Rehabilitation Studies to answer this 
question on a random.sample of eight reports. The consultant 
worked with Evaluation Services and project staff on December 17, 
1979. The outcome of that meeting is the draft instrument 
presented Attachment 5. 


It is the judgment of the Senior Evaluation Manager that this 
instrument operationalizes the intent of objective 1.0 and 
will successfully capture the information necessary to evaluate 
the accomplishment of objective 1. 


Additional. : 


Evaluation Services worked with the project manager in designing ‘and revising 
the needs assessment instrument attached--VACs and Job Analyses (Attachment 6). 


7 PROGRAM OBJECTIVE 2 


a 


By May 30, 1980, a minimum of sixteen handicapped students, 
e 
having the benefit of a completed comprehensive. vocational 
evaluation, will have an IEP developed by the ARD/IEP com- 
mittee recommending specific programs ae an instructional 
option. Accomplishment of this objective will be evi- 
denced by. two-thirds of the vocational counselors and 
diagnosticians who served on the ARD/ TEP committees indicat- 
ing in a structured interview that the Vocational Evaluation 


Report was useful in planning improved instructional options 


for the handicapped student's individual education program. 


; E.Q. 4 How were the vocational evaluation reports used and what could have 
“ . been done differently to increase usefulnes& of the vocational 


co 


evaluation reports? : 


(A) Réadership was a functioa of “EA but many relevant educators were reported 
to have discussed the reports. For six of nine cases definite use was made: 


Case 1: ® Change in perception of the student by the vice-principal. 
«Possible future changes in vocational program placement and 
class schedule 


Case 3: ® Student ARDed into adapted resource room and placed in 
cafeteria job 


Case 2: e Student ARDed out of special education 


¥ 


ase 5: e Change in perception of student by VEH teacher 


ase 6: e Change in perception of the student ty many relevant educators 
® Planned vocational training program established through 
Rehabilitation 


Case 7: © Academic instruction in functional skills through Rehabilitation 


¢ Full time OJT slot set-up 
¢ Student referred to counseling : 


For three cases limited use ocurred because of factors not under ESC-20 control: 


: Case 4; Lack of use due to student personality, family constellation, . Li 
and timing of referral : / 
_ . Case 8: Lack of use due to factors internal to Cooperative ° / / 
: Case 9: Lack of use due to factors internal to Cooperative and, Peal 
| _ student's parents j : 


(B) For the majority of cases readers were very impressed with che reports which 2 
were perceived in all cases as understandable ana in seven of nine cases at* / 
the right level of detail. The only thing which could be improved was a / 

i "need for debriefing" which was mentioned by several interviewees. | 

‘ 7 / 

(C) Purthermore, for three of the five districts important spin-off effects on! 
the secondary special education program in general were noted, suggesting to 
the independent evaluator the potential this project has in affecting the 


total secondary program. . 


7 a 


eee e. Gap, gene a eo ay ee es Os 


E.Q. 5--- - Are-the vocational evaluation reports resulting in the iptanning of: __ 
oo 
} . 


} 


improved instructional options for handicapped students? 


i 


é 
Definitély. 
- fu 

Me-third, and negligible in the remaining three®€ases because of flactars 

external to the Vocational Evaluation Center. . 

{ 

For three cases (3, 6, and 7) definice "improved instructional 

i 

*, 7 


options" were planned. 
For three cases (1, 2, and ©) much less definite "improved {nstyuc- 
For case 1 the major imptovement; may not 


Reading the cases as a whole is the only‘ way to capturd the 
pact which was extensive in one-third of the cases, quite modest in 


eventuate, or may, but change in perception of the student did 


“se 


tional options" resulted. 
occur; for case 2 the student was dtsmissed from special education 


with the diagnostician/ ungute of the future -improvements possible; 
and for case 5 improvément wastin perception of the student, albeit 
; fg 


\ 
an important change. / 
~ i 
1 


For three cases factors not under Et -20 control accoufited_for lack of 


any substantive improvement. 
e 


i 


e 


©: re 


CASE 1' 


_ Tested: Nov. 8, 1979 Report signed: Dec. 20, 1979 Interview: April 9, 1980 


Approximately two months after the receipt of the report an ARD was scheduled; 
however, the mother cancelled it and it was pending. 


No changes have been recoumended for the student's instructional program. 
Change has occurred in the vice-principal's percepts cf the student. The 
vice-principal is more aware of the students interesis and motivatigns and 
is not iude‘ng him as harshly, Future change, a possible vocational program 
placement and class schedule change,is a possibility. Both the change in 
the vice-principal's perceptions and possible future changes would not have 
occurred without the vocational evaluation report. : 


According to the diagnostician interviewed the benefits may.or may not add 
up to “improved instructional options": "He is a really confused person 
and we have isolated thg discrepancies between his real self and his view of 
himself.’ There is either going te‘be major change in the student's total 
education or no ch-nge." 


‘The diagnostician also thought the vocational evaluators were very cpen; 


specifically, they gave student's feedback as they were tested. The diag- 
nostician did not see any benefits to the district's secondary special ' 
education program as a. spin-off from this case. . ' 


e 


CASE 2 
: A 
Tested: Nov, 1, 1979 Report signed: Dec. 13, 1979 Interview: April 9, 1980 


Approximately ctwo months after reeeipt of the report an ARD was held and the 
seudent was dismissed from ‘special education. This change would heve occurred 
at some later point without the vocational evaluation report. However, the 
repor: gave data which confirme* the teachers’ judgments. - 

According to the diagnostician interviewed the benefits the student may 
receive do not add up to an "improved instructional option". The problem 
however is with the student end not with the vocational evaluation report 


or the district. , 


f 


CASE 3 


Tested: Nov. 15, 1979 Report signed: Dec. 10, 1979 Interview: March 28, 1980 
After receipt of the report the student was ARDed into an, adapted resource 
unit for teaching prevocational skilis (two periods/day) ,and a cafeteria job 
(one period/day). These changes in the content of instru. -ion and job place- 
ment were definitely helped by the report which was sort’ of a catalyst. 


. ” 


According to the diagnostician, teacher, and supervisor interviewed the bene- 
fits the student may receive do add up to an “improved instruct ional option" 
that will somewhat better meet the student's needs. Furthermo¥e, the inter- 
_viiewees noted that, by chance, this student did not show the “immediate 
dramatic effects", which several other students sent to the Vocational Evalua- 
tion Center did show. 4 - = 
The interviewees mentioned three spin-offs-to their district's secondary 
special education program: (1) the devedepment of he adapted resource room, 
(2) allowing other students and their needs to be seen and understood by LEA 
staff, and (3) encouragement to other districts in their Cooperative to refer 
‘ students*to the Center. 
The interviewees went on to say how impressed they were with the evaluations, 
the opportunity to participate in the testing process, and the future train- 
ing possibilities. They noted how "very observant" the vocational evaluators 
were in picking up on and acting on data that was not part of the formal 
referral, Also mentioned were their willingness to have an interpretation 
session with the parents, the use of many different tests, ond the explanation 
of norming considerations. 


CASE 4 
Tested: Nov. 6, 1979 Report signed: Nov. 21, 1979 Interview: March 27, 1980 


This student was not referred for a change in program and consequently no ARD 
. was held. There were no changes in the student's instructional program, The 
counselor attributed the lack of change first to the student himself (aggres~ 
sive, does not get along...), second to family factors (11 siblings, dropout 
.. history, parents do not care), and third to timing (perhaps a year or two 
early). ‘The report did show what the student could do, but this just verified 
what teachers thought. according to the cuunselor no benefits will occur. 
The counselor added in the case of a different student, the one female out of 
a large group of referrals, he would have preferred some resting more specific 
to females. 


CASE 5 
Tested: Nov. 6, 1979 Report sigued: Nov. 19, 1980 Interview: March 27, 1980 . 


This student was not referrei for a change in program and consequently no ARD 
was held. A direct result of the vocaticnal evaluation report that would not 
have otherwise occurred, was that the VEH teacher was able to pf‘ -oint what 
the student did best. The teacher changed his attitude toward ti ident, 
seeing him in a new light and dismissing the idea he could not do enything. 


iin 
. 


ERIC | | 42 


According *to the coungelor interviewed the benefits may add up to an "improved 
instructional optional"--primerily relating to objectives emphasized, teaching 
strategies, and perception of the student. It is aiso possible that the report 
might help the student decide what he might do for a living, "down the line." 


A benefit to the district's secondary special education program was aoted. 
The regular teachers with special education students are now asking for all 
their students to be evaluated, even their 7th and 8th graders. 


The counsélor also commented that ‘this was the most outstanding evaluation 
he had ever seen, it as written for teachers, it went into detail, and it 
showed regular teachers exactly where there were deficiencies. 


ra 


CASE 6 
Tested: Oct. 8, 1979 Report signed: Oct, 30, 1979 Interview: April 2, 1980 


This student was not referred for a change in program; he was referred so his 
district could better serve him. Nonetheless, an ARD was held. However, the 
student was hospitalized before any change could be acted upon. Three primary 
‘changes have occurred: (1) the student is looked at differenily (VAC, parents, 
and Rehabilitation see areas he has potential in), (2) a planned training 
program paid by Rehabilitation at a private school is set up for this student 
once he stabilizes, and (3) the student's own choice of auto mechanics was 

" gupported. While the VAC believes these changes would have ‘oecurred without 
the report, having the report allowed the district to recommend the student 
now to Rehabilitation. 


According to the VAC the potential benefits to the student, once he is 
stabilized, will be "improved instructional options” which will Le a major 
improvement in the student's total education. m 


The VAC went on to say the LEA has greatly benefited. Vocational evaluation 
reports have "been fantastic in planning their future." The vocational 
evaluators were seen as highly educated and knowledgeable and spending 4 lot 
of time giving teachers concrete information, 


CASE 7 
Tested: Cct. 8, 1979 Report signed: Oct. 22, 1979 Interview: April 2, 1980 


This student was not referred for a change in program; he was referred to con- 
firm his interests and abilities and supply data necessary for a referral to 
Rehabilitatien, Nonetheless, an ARD was held. Three primary changes have 
occurred: (1) Rehabilitation will be providing academic instruction in 
functional skills, via a private clinic, (2) the student was placed in a full 
time OJT slot, and (3) the student is being referred for individual counsel- 
ing. According to the VAC the student would have been eventually placed in 

an OJT slot, but the report allowed the district to get Rehabilitation in- 
volved, get a full time slot, and get supplementary academic training. None 
of this would have been possible without the report, 
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Accarding to the VAC the potential benefits to the student will be "improved 
instructional options" that will be a major improvement in the student's 
total education. Especially important to this student was showing her she 
had strengths and could experience success, aS she experienced Success at 
the Vocational Evaluation Center itself. 


The VAC stated that the Vocationat-Evaluation Center work is influencing 

the philosophy of the LEA's secondary special education program and at one 
high school the district is planning to change the secondary curriculum to 

a functional skills curriculum as a pilot project. Furthermore she stated, 

"I wish we could clone the center"--they really looked at the total girl and 
what we needed to make her an independent adult, especially what we could 
work on: in the social behavior area. Also, she passed along the Rehabilita- 
tion counselor's comment that this was the best vocational evaiv.ation he ever 
had seen. Having the reports really convinced, people in authority to do 
something. One final comment she made was the way the two vocational evaluators 
from the center complemented each other and how much of the quality depends on 
their competence. 


CASE 8 
Tested: Nov. 11, 1979 i.port signed: Dec. 12, 1979 Interview: April 22, 1980 


This student was ARDed prior tc the vocational evaluation repc , the referral 
was to see what we could poss‘ble offer her in VEH. No changes have occurred. 
The VEH teacher did not recea’e the report through district channels until 
mid~February and the VEH program, in a new building, did not’ start until 
March. There was little 0, no communication to this teacher about the report 
from the Cooperative's central office. The teacher did state that potential 
"improved instructional options" could "oossibly" result in the area of objec- 
tives emphasized, However, other statements she made contradicted this: 
"T'm not really familiar with the suggestions and not using them now; we are 
into practice and cannot stop for skills training." 

3 i \ 
Because (1) the report was not forwarded by the district until late in the 
year, (2) the program was new, (3) there was little or no district (or ESC) 
follow-up, and the srudent missed the ride for one day of testing, the effect 
of this repor* was negligible. \ 


\ 


CASE 9 
Tested: Nov. 13, 1979 Report signed: Dec. 17, 1979 Interview: April 22, 1980 


This student was ARDed prior to vocational evaluation; no new ARD was held. 

No change in her instructional program occurred; part of the lack of change 
was attributed to the student's parents who would not allow her to enter a 
special pilot program. The teacher really had to "stretch" to see any 
benefits, though she stated gome future "inprov’ed instructional options" were 
possible, especially in objectives emphasized. Since this was the same LEA as 
in -use 8, the same situational factors were operating. The effect on this 
student appeared to the interviewer as negligib’« as in case 8. The teacher 
interviewed did comment that the students cnjoved being tested. 
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DATA FROM ALL NINE CASES 


Who reads vocational evaluation reports? 


Readership is a function of the LEA. - 


For three of five LEAs anywhere from four to nine persons in relevant roles 
read the reports; in two LEAs only a teacher or the diagnostician and teacher 
read them, 


{ 


ee discusses vocational evaluation reports? 
A Many relevant persons 


For four of the five LEAs about six persons in relevant roles discussed the 
report. 


‘What were people's reactions to the reports? ; fe 


For the majority of cases the readers were very impressed (see comments). For 
the remaining cases it more confirmed what people knew. 


"Very thorough" -- "confirmed what I had hoped" 
"Boy, there's a picture of ! Now we see why he acts that way" 


"Impressed with the meat of it" P 


What use was made of tt? 


For six of the nine cases definite use was made of the report. Use ranged from 
changing the attitude of educators toward the student to actually ARDing student 
into relevant services. In three cases use was very limited because of factors 
in the student (1 case) and LEA (two cases) not because of the quality of the 
report. 


Were the summary and recommendations ... too sketchy ... juet right ... too 
detatled? 


Seven of nine cases were perceived just right. 


Were they understandable? 
All nine cases had understandable summaries and recommendations. 


° 


Did it cover what you wanted to know? 


In only three cases were any substantive areas cited: 


"T did not see my "answer" -- did not say "how to" -- restated what we were 
aware of 


"Did not specifically address local VEH program student was Ss 
"Did not cover how to motivate student..." 


What tf anything ... could be tmproved? 


Only one thing --- three persons mentioned need for debriefing. 


- 36 - 


cation Service Center Special Education/ ~ 
gion 20 Evaluation Services | 


Student 
District 


Campus 


x 


a VOCATIONAL EVALUATION REPORT INTERVIEW 


Interviewee 
Interviewee Role = 


Interviewer/Date : / 


a 


Date vocational evaluation began 


ee 


” 


If the student was referred for a change of program, since receiving the completed vocational 
evaluation report, has the student been ARDed? © 


If so, what changes have been recommended for this student's instructional program as 4 result 


of the vocational evaluation? 


If not, what changes are being discussed? 


shat area(s) have the changes primarily affected? (Check as many as apply.) 


nooodd 


- 


classroom materia)* or instructional strategies 


-entent of instr .on (objectives) 
vocational program placement ( planned actual) 
job placement ( planned actual) 


none of the above 


Would these changes have occurred even if you had not received a vocational evaluation report? 
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What have been or will be the greatest benefits to this student Ecos having received 
his/her vccational evaluation? 


e - 


Have there been any benefits to your school's secondary special education program as a 
result of sending student(s) for vocational evaluation? 


Do the benefits and potential benefits to this student really add up to "improved instruc~ 
tional options" for this student? 


No 


Yes, benefits relate to what objectives are emphasized, teaching strategies, 
how the student is being perceived since the evaluation. 


Yes, benefits relate to a course, job, or program which somewhat better 
meets the student's needs. s 


Yes, benefits relate to a course, job, or program which will be a major 
improvement in the student's total education. 


Poe 


What, if anything, in your local setting may be inhibiting using or acting on this report? 


‘<) 
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How was the report actually used? 


’ Who read it? 5 


Who discussed it? 


: ’ 
What were peoples reactions to it? 
What use was made of it? 


What, if anything, in the reporting of the vocational evaluation could te improved? 


Were the summary and recommendations sections (cgpy attached) : : 


C] too sketchy? | | just right? CJ too detailed? 


Were they understandable? 7 
Did they «over what you wanted to know? 


What, if anything, in the process of referring, intake, scheduling, debriefing... could, 
improved? - 


Any other comments? 


‘ 
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PROGRAM OBJECTIVE 3 


By March 30, i980, project staff will develop and disseminate a manual 


containing information on the Model for Planning and Coordinating Pro- 14 
gram for Secondary Handicapfed Students. Accomplishment of this ob- ‘ 
jective will be evidenced by: 
(1) the complete description of the model specifying: 
| (a) Initial steps to be taken 
(b) Workshop outline for sdntadstvation tn the Child Centered 
Process 
(c) Form used to evaluate tests 
(d) Form used to survey vocational courses 
(e) Form used 7 record community resources and related services, 
both available in school and out of school 
(f) Comparison of eight vocational evaluation systems to be con- 
sidered. 
(g) List of resources, both state and national 
(h) Workshop outline for effeccive communication: skills to work 
with parents. 
(2) documented mailings (brochure): ESC special education directors, 


CITE, TEA, special education and vocational personnel, and the 


approximately fifty school districts in Texas with 5,000 or 


greater refined ADA describing the model. 
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EDUCATION SERVICE CENTER, REGION 20 


INTEROF FICE COMMUNICATION 


TO: Jane Francis 
FROM: Stan Drezek ’ . 
SUBJECT: Amendment to Evaluation Plan 


DATE: March 7, 1980 


Per our discussion this morning, Evaluation Services will drop EQ's 6 
and 7 relating to the third objective (manual)™and use the time saved 
to conduct on-site (not telephone) interviews with users of vocational 
evaluation reports. We agreed this data would be more useful to you. 


SD/es 
ec: Patti Myers 
Alan Roecks 
Tom Toleman a / . 


: Stan Drezek (Project Files) 


an 
‘ Jieated iw her yoit 4\vat Bwwnrce e. 
: 4" nave ont been 


% TEA moni TOr 


& cry sgstne\ ebb ees Me \ . 
3 \pecuvse. Nhe maven, nee 
a7 


ais 


” epeciSics 
deGrred by re ogenty 


to eelete 3 Awese g pei? wm 
wold wet be ob @RproR 


seat ee 3 


te as arave seS na ro hes, 
i al 


& 


J! 


‘<) 
ERIC 
a -4l- | 


= \ 
\ : “ 
‘ ; 
ADDITIONAL. WORK 


= 42 = 


-_ ) 
i ENUCATION SERVICE CENTER, REGION 20 
} . ¢\e>, 
: INTEROF FICE COMMUNICATION ‘ et 5 
: v\ 
come 
if < / 
: _TO: Jane Francis / 
FROM: Stan Drezek 


SUBJECT: Needs Assessment data on Job Analysis 


DATE: March 6, 1980 


Attached is the UED page presenting what I thought might be the major findings 
from this needS assessment. 


The attachment labeled "Summary" presents the more detailed item-by-item data. 
Also attached are the data for items 2, 5, and 7, 


Accompany ing your copy of this memo are the raw protocals for further use, 
e.g., ‘seeing who specifically signed up for training. 


SD/rg » 
cc; 
Tom Toleman 
Tom Sanford- 
Stan Drezek (Project Files) 


O- 
_ ERIC 


FINDINGS Pa 


A. Visits and calls to prospective employers are the 
most frequent techniques for finding jobs. 


\¢ 


B. Only about half the VACs can place all their handi- 
capped students or have sufficient contacts outside 
their school district. MR and ED’ are the most 
difficult to place eligibilities. oe ; 


Cc. “estaurants (especially fast-food), public agencies, 
grocery stores, and retail stores are the most fre- 
quent Bexar County businesses cited as continual 


placemencs. 


| "D. Only four VACs scesantly do Job Analyses and 77% 
| (23 of 30) would attend a 5-day training session, « 


' 

a \ 

1 £E, Both an occupational file and slide-tape career 
awareness inventory specific to Bexar County jobs 
would definitely be ead a to about 60% of VACs. 


a 


"Action means concrete policy,: procedures, decisions, or isesgmente. 
"No actior' may be ayorntnce but should be explained for the record, ; §.! 


4 
| 
| 
| 
| 


| 
| 
| 
| 
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_._ USING EVALUATION: DATA 


° | ACTION 


Review and use as appropriate in ee the 
proposal on Job Analysis : 


SUMMAPY \ 


1. Techniques VAC's now use to get jobs 


Rank (..ominated ) 


Technique : 
' 1-3 4-5 6-8 
: Aeh use 
td 
Visits to prospective employees 29 2 1 
- Telephone calls to prospective employees 22 6 4 
- Variable use : ‘ 
Requests from, employers themselves ) 20 6 
Student fir 's own jr% - 10 13 12 
. Word of mouth 11 7 14 7 
Ads in nevspapers 12 6 i4 
re Other VACs 9 5 2) 
Little use 
. Local civic crganization 1 7 31 
‘ : 2. Q. Can you viace all your hundicapped students? 


A. 50% (16 of 32) answered No. 
See comments on attachment. Most frequent ‘comment appears to be 


x 


difficulty in placing severely handicapped.. ; 


»Do you sufficient contacts outside your immediate school district 
' co ty to find appropriate placements for all your nandtcapped 
students? 


®, 47% (¥5 be 32) answered No. 


4. Q. What handicapping vategories prove ih most difficult to place? 
\ A. MR and ED 
5. A list of places of business in Bexar County worked with @n a continuing 
basis is provided in the attachment. a 
The most. frequently cited type» of business (30 or more nominaticns) were 


“Restaurants (basically fast food) 
‘Public agencies 


' “Grocery Stores 7 = a 
Another frequent type of business (approximately 20 nominations) 


*Retail stcres 
i ., aoe 
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Other less frequent types of business (approximately 5 - 10 nominations) 


"Construction 
“Motel Hotel 
*Manuf acturing 
-*Car wash 
*AFBs 


6. Q. Do you ever suggest to an employer modifying a job to make it posstble 
for a handicapped student? 
A. 47% (15 of 32) said "yes"; an additional 25% gave an answer indicat- 
ing they did, but not very often. 28% said "no". 
7. Q. On what busis do you maich students to jobs--or ts it just taking 
whatever jobs are avatiable at this point? (see attachment) 


A. While a few VACs admit taking whatever jobs are available and availa- 
bility is mentioned as a significant factor by a few more, students 
interests and abilities are cited as the primary bases fae matching. 


8. Q. Do you presently do somzwhat formal Job Analyses pee to placement 
of handicapned students? 


A. Only four VACs responded "Yes". 


9. Q. Do you have a copy of tne DOT? 
A. 47% (15 of an). responded "Yes". 
10. Q. Would you aed a 5-day session scheduled in early June 1981 to 
train you to do Job Analyses specific to Bexar County? 
A. 77% (23 01 30) responded _ "Yes", 


11.. Q. Jf as a result of this project an Occupational File of Bexar County 
jobs was developec, would this be useful? : 


+ 


A. 62% (20 of 32) responded "Yes"; an aiditvons: 31” vr 2sponded npestere 


12. Q. Could you use a stide-tape career quareness inv. atory of jobs avatl- 


p able in.the Bexar County area? é. 


A. 56% (18° of 32) responded "Yes": an additional 40% responded "perhaps"s., 
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. ; Atlachment | | . . 


4 ac 


| “Ttem2, Can you place all your nandicapped students? 


Moz my Wy 
Yes ww Wl 
Let a of uM ee : | 


With gdaus of 40, a ov 3 ctidevits withot jules 
Nut aluays whew 3 Cael Ther chold be bY T ulvass phe 


‘ Have trouble placing TAR 
With help of TRO this can usually be accomplished 
Uswatly , Evertuatty, Somilimes depent om TRO for Tea tning Fist 
Sever ily of handica pped prevests hinfher Te be employable 


They can be placed ef Goodweill NerTh or CUT In some arcas for pey— Many con't 


compele in open job mar Ket 


Seme are on the rolé, but Their impairment is Teo Severe far employment 


Pre blem with aqe, Trans pectation ~ Physical hand cee pped 
The problem is not placing , bet holding The job 


Seme take a lenge Time 

Hewerer, new info is , welcome 

Lack of adequate preparaleon F a . 
Yes, 1F by “placements We include beth Ttreining + work staTlioas 


No available +. aiming Feciittes Lax severely handicapped categories. 


Free-lance werk wes wtilreed tn Ltew Ff salaried employment In area ef ar 


. 


If T am allowed to decide when a Student is jee ready, Tusually can piece 
Everyone. But ARD Comme. have « tendency to cvertule VAC recommendation. 


J can ucually, Va Some «ee Unable to held _job due te Their Emotional problems. 


~ 
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| 1 Woodlake Country Club 
D St. Monica's Academy 
1 Judson ISD 
1 City of Converse 
| El Nacho Grande 
| San Antonio Track Center 
| Alamo Enter prises 
| Feed City 
| Deluxe 


x One regertad she did net care te share this info. wiTh cther wns Bat did (ist businesses 
she had The best results with in Ave yesrs. 


* che reported There were ne places she could use eon continuing ba SIS 


 eRIC"™* places out of Bexar Co, were listed | but not added te Tally. 
= \ - 480 


=- 


an, 
a 


D Burnep + Sims - Lene Star Blvd. 1 Cure Cola 
/ 4g Beret Co. Laber Commun ly Agey: l Rain be Bakery 
/ Victor - Temporary Services Emp.Aqcy: Hat< Way Hevaie 
ene | Reeves, Reefing Ce- 
4 FR-YoP Program ; { F I n 
/ kell AFR = Oak Hills Met r a 
/ Rake ph APB Duka Tre. 
Ml \, \ AF fl Wwhet- A- Burger 
Lace B n Deta, Poiit Corp: 
M Padre! Fouls Clechled AFs) 1 Ancira Winton Chews 
{1 Wryalt'’s Cofeteria 
/ Towa uf Anevrue 1 Western Auto 3 
i TEC bens rrrptay mrenct Comer 
/ S.. A. Terrie Ryusion (Sh, )\ Certe) ee Dept. ef Pablie. Safety 
/ Ceritene food Stores Ji MMA a 
i Buyer CheE [ CP Center . 
© cco , : { Pain Libewary - Beoks by mail 
I} n @ Vocational - Evaluction Center 


| wh ote wT ae 


EB e 
H ERB Ware hen” ee 


Bex Grit Aare (2) Ll cathe heenbiller - 


7 Metre pel Mon Hespilal 


f SAISO | 
1 S\leTer While Cleaners 


e : : a 
> / Bexar County oHecptial J ARA Feod Serwce 
fe Td TRO rg 
5 ¥ o Red Lebstor { ARA Food Services Tetnity U. 
LP oF Tran setols (2) app. ac - S 
2) 25 . . { RA Food Serviess Ac 
4 ot / a s ie nearer / Downtown businesses 
. ! Codes ; Wt kewt Straues : 
/ ice Manufacluring : ! Higaway Constructirn 
I Modery Manufacturing I! Church's Fried Chicken 
/ Greenwood Bar BQ if Plaza Nactonat Hefel 
to. Denn 's J K-P Cef€ee Shep 
| Wilsen Lumber Co- { Hilten Palacie de Rie 
I NISD {I Teyata of San Antente 
1 K- Mert t Mame ren Werks 
Hl Me r Hotel i Bordier, Nursery 
I Gunn Ofdsmobile Ml ASG Ald rege Nursery 
qt! Winns Warcheuse : il Joskes 
Hartandale Scheel Cafeterias AY Mc Denalds 
] Harlendale Cafeterias I Cumin j ssaries 
I] A\wert sens . 
| Federml Programs WH aady Andy 
I OUT Cafeteriosn in Schoof Dist. { “£78. 
JL City of SAT a D Greentouse Produce 
He Ray Ellison Component Division tos lit Sambe's 
Ht Ray Ellison { wltte Museum 
[Sim's Coffee Shep .{ Sears 
1 Hilton I El Rancho Restaurants 
/ Gul Car Wash on bia Fe em (1) Standard Taductries 
\ | Bustness Peotessronel Forms Il Prefit Feeds 
I Kent aeky Fried Chicken tH Luby Is 
I Standard Bee i Village Grocary 
ul 2achery roductS { Eunon Car Wash 
1 HB Zachary ‘ ' 
Lt Scaculer / Al's Car Was’. 
Ww Blackwell Burner {  Crevn Ridye Town Homes 
@ "© se Wo Gatlaghers ResTan rants 
ERIC ie ak [ &-n Antonio Sarble 
oe 1 La Measien 


H Sewel Foliage 
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7. On what basis do you match students to jobs--or is it just taking what- 
ever jobs are available at this point? ate se hale Ae 


List ait o& compas he 


mw eouk Mmuny yobs ave duhen yt recuse Ahes ave woul & voc. emer v nee 


A Neat cgay WA 
= asy xo ma “wa yea vtude,t tells we ‘ne Vihear ov abe 
Student iiterest + ebilifies 


Try te maleh on interest (jpb availability, lack of transportation ele. Ct*8e5 problems) 


Base on job avertable suited te best applicant whese “interest closely matches 


Jobs they are interested in 
Where They are trained of Shewan imterest. Mesi ef my girls are trained in Feed Service © 


Sewing (atew). TRC trains Some, Also use AM Skills Center. 
Eeomeel ay yorarstes te delevewe wtevests 3 I Ay to let thes waheudeution , 


Match student t job They are interected in 

Yes To the latter part of questin 

Match students strengins Te job requirements . 
Ves, for best advantage of employer end studeat ” 


SKills Required, 


. | 
Skills Required y ; 
Try hard Te match Te jeb site. Place at whatever avetlable fe gqein Jeb skills th 


reve to more appropriate placement. : ! 


Inve sligate gob tasks; review studlest's pest experience + Training > sun observations 


M.Ke Crery e4Sort Te male student's need he its o . te : + T. 
5 Aclot To ajob LT feel he will not cr Pee beee sy ei oP eee 


Every eect Is made Te mileh; in liew of this ~ They tee what Is availeble worked 
ae proper yok Comes up. : 


Abslities | interest, Transportation . _ 
L try Te oneteh intercats + capabilities when perssble 
LT almest always try Te maih studedts Te jobs ; 
Determine voc. interests by KRi0t or Kudaw determme ability by consulting ps choltgscal 
establish goals > Ccensider pest experience and Si nancial needs; cons tder cppactecit 


new skills 5 inveshiqefe Community — Support ive progress for finescral atd tn SKI Trduing- 


Invest, abitity + availability must all 3 be present . 
By working with student one he each day. Test in different voc. areas. Get te 
Know student and whet he can oo : - 


No way ~ L malch tnteresf 4 fancToning G bility To every Jeb I gntdee a. 
Stdant eversses a dewwe mostly : 
p-Th 


a — * ——. _ bt te Secure an€, 
According Te voc - appraisals, ~v interest inventory, whend am abi¢e : ; 
EferT is made fe Sind De in area of. students interest. [: 
Jobs swled te students abilities - 50 - 


_ WORKSHOP EVALUATION REPORT 


WORKSHOP TITLE: Vocational Evaluation DATE OF WORKSHOP: 8/28/79 


CONSULTANT/PROJECT: Tom Toleman & Tom Sanford/Vocational Assessment of the Handicapped 


° 


EVALUATION STAFF PREPARING REPORT: Jay Alexander REPORT: DATE: 9/7/79 


WORKSHOP DESCRIPTION ; _ 


MAJOR OBJECTIVES (SUMMARIZED): Participants will be able to list 


. 
(A) vocational assessment areas 


ra 


(B) appropriate reasons for referral - 
(C) tests by assessment areas 


LENGTH OF WORKSHOP: 2.5 hours 
OUTSIDE CONSULTANT: 
AUDIENCE: 
Number attending: 13 ' aa Percentage completing WEF: 77% 
Type of Participants: 7 Educational Diagnosticians ° -- 
6 Other educators 


Percentage attemgding at their own request: 13% 
Percentage attending as a requirement (okay): 88% 
Percentage attending as a requirement (not okay): 


FINDINGS ON THE CONDUCT OF THE WORKSHOP - 


An analysis was made of the responses to “process” items which describe the 
conduct of the workshop. The percentage of positive responses to each of the 
"process" items is presented below. 


PROCESS ITEMS PERCENTAGE POSITIVE 
RESPONSES 


Three-quarters or more of activities contributed 


to accomplishment of workshop objectives a ee 100% 
Length of workshop was just right .......... 89% 
Adequate pre-workshop information. ......... 63% 
Held at a convenient time... .. 1... 2.2. wees _ 100% 
Adequate facilities . . 2-1 ss ee sw awa ; : 100% 
Well organized/conducted. .. 2... 1.2.2.2. 2 eee 89% 
Appropriate audience participation. ......... 100% 
ERIC Content covered in workshop was meaningful. ..... 100% 
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FINDINGS ON THE IMPACT OF THE WORKSHOP ; 


An analysis was made of the responses to the "outcome" items which describe the 
impact of the workshop. These results are presented below. 


A. Most ( 89% ) of the respondents indicated moderate 
or substantial new learning. (Question 7). This places the workshop 
at the 78th percentile for Special Education workshops. 


B. A little over half ( 57% ) of the respondents indicated they will 
apply their learning, which could result in moderate or large increases 
in effectiveness. (Question 8). This places the workshop at the 17th 
percentile for Special Education workshops. 


- all (100% } of the respondents probably or definitely 
would recommend this workshop to their~tolleagues. (Question 10). 


D. ti ( 1a0z ) of the respondents indicated there was 
a need for additional assistance to implement the training received. 
(Question 9). 


25% indicated workshops needed. 
EY: indicated consultant visits needed. 


387 indicated workshops and visits needed. 


PARTICIPANT COMMENTS 


Comments were few. Three persons mentioned the overall information as helpful. 
Other individuals’ mentioned as most beneficial the "hands on use of materials," 
the "awareness of vocatiénal factors to consider," and the "identification of 
students needing help." 


° \ 


limited (I7th percentile); however, the workshop was only 2.5 hours long. All 
of the participants indicate the need for follow-up. The project staff might 
judge whether the low rating for application indicates any action. 


UMMARY AND SUGGESTIONS 
Comments indicate a well run workshop with the possible exception of adequate 
pre-workshop information. Most respondents (89%) indicated substantial new 
learning. However, the perceived application of new knowledge is somewhat 
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EDUCATION SERV:CE CENTER, REGION 20 


INTEROF FICE COMMUNICATION 


| 
TO. Jane Francis, Tom foleman, and Tom Sanford ‘ 
£ROM Stan Drezek 


SUBJECT Notes on 9/5/79 Inservice 


DATE: September 5, 1979 


I thought I should share what 1 learned and what I was concerned about after 
attending this session. As always these are my personal observations to be 
“ re-evaluated after talking with you. : 


My concerns: 


First, the projec. evidently has put effort into PR (brochure, open-house, 
calls, visits scheduled...) but attendance was limited to about 18 persons 
representing less districts than project staff would like to reach. In- 
volvement of district staff was a large problem last year. Are our mailings 
getting to the right people? Are we scheduling workshops at the best time? 
Do we need to focus on VACs and counselors more than administrative staff? 


Second, the audience wanted service--and service today. We kept reinter- 
pretting requests for the specifics of service (...e.g. How many kids from 
my district?) into abstractions about the developmental nature of the pro- 
ject. Somehow I think we made a mistake on our first objective. I be- 
lieve we stressed the words "comprehensive and complete" (thank you Tom 
Toleman) when we shouldn't have. Our process and forms are too much. What 
the LEAs appeared to be wanting was not all that information but limited 
information. I got the feeling our form was shortest just where we want it 
longest: Referral reason and recommendations. But we sure got everything 
in between. Also, it appears we've got to stress the work sample informa- 
tion-~that is what the LEAs cannot do and desire. I believe we need to 


completely rewrite objective 1.0. 


Third, ya'll are never going to be able to visit as many high schools as 
youre planning and collect as lengthy data on the Vocational Programs Data 
Sheet as vou plan. Can't we come up with a longer range more efficient 
process. I really started to feel we're promising much toomuch. 


Forth, we really did not give them time to critique our forms. Instead we 
interpretted to them what we wanted. 


I did learn some things: 


1. You are very concerned about developing an efficient process. 
‘ 2. You are taking the proposals very seriously 
3. You are mainly interested in mildly, higher-functi:.ing handicapped - 
children, i.e., those who wouldn't later be TRC candidates 
4. You do nct want to do vocational assessments on students whose func- 
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tional skills would prelude employment 

5. You are highly student-centered; the student, but perhaps not his 
parents woulda get feedback 

6. You plan to draw upon other consultants, e.g. Related Services 
personnel 

7. You have done a lot of thinking of what the content of the recom 
mendations section appears to be: vocational goals, academic goals, 

— specific skills, suggestions for 4-yr. plan, Follow-up, Related Ser~ 

vices, curriculum,... 


’ Attached is a list of questions the audience asked. 
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WORKSHOP EVALUATION REPORT 
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WORKSHOP TITLE: Communication Skills for Conducting ARD DATE OF WORKSHOP: 1-24-80 
Meetings 
CONSULTANT/PROJECT: Diane Mosley/Secondary Handicapped 


EVALUATION STAFF PREPARING REPORT £laine Sebald | REPORT DATE: 2-5-80 


| WORKSHOP DESCRIPTION > 


MAJOR OBJECTIVES (SUMMARIZED) : Given an agenda which conforms to the steps of 
problem-solving, one-third of the participants will conduct an ARD meeting in 
which common goals among members with initially. conflicting points of view are 
"established to the satisfaction of staff members and observers. 


/ 


LENGTH OF WO8KSHOP: 5.5 hours , 
OUTSIDE CONSULTANT: mane 
AUDIENCE: Number (%) completing WEF: 13 (68%) 


Number attendjng:- 19 


Type of Participants: Almost half (46%) were guidance counselors, and most of 
the remainder were VACs (15%) and administrators (23%). The majority (85%) 
worked at the secondary level. 


Percentage attending at their own request: 15% 


Percentage attending as a requirement (okay) : "77% 
Percentage attending aS a requirement (not okay): 82° 


FINDINGS ON THE CONDUCT OF THE WORKSHOP 


An analysis’ was made of the responses to "process" items which describe the 
conduct of the workshop. The percentage of positive responses to each/of the 
"process" +tems- ts presented below. 


PROCESS ITEMS PERCENTAGE POSITIVE 
| RI.SPONSES 
o Adequate pre-workshop inform ion . ok ae Se 58% 


Held at a convenient time. .......... aa ee 100% 
Adequate facilities ... : 
Wel] organized/conducted. Se) ok ee 
Appropriate audience participation. .... © 100% 


Content covered in workshop was meaningful ° 100% 


Length was just right (long, short). ........ 77% (0% .23%) 


Q@ 7 : 
ERIC Three-quarters or more of activities contributed 
cemeaeed to accomplishment of workshop objectives 


Mi te te gn 


FINDINGS ON THE JAP ACT OF THE WORKSHOP 


An analysis was made of the responses to the “outcome” items which describe the 
tepact of the. workshop. These results are presented below. _? : 


A. Nearly all ‘  ( 92% ) of the respondents indicated moderate. 
or substantial new learning. (Question 7). This places the workshop 
‘at the 80fh percentile for comparable workshops. 


; ; 
| B. Most . ( 85% ) of the respondents indicated they will 
| apply their learning, which could result in moderate or large increases 
| in effectiveness. (Question 8). This places the mopE=nOp at the 


72nd percentile for comparable workshops. 


Gs Nearly all ( 92% ) of the respondents definitely 4 
vould recommend this workshop to their colleagues. (Question 10). =~ : * 


\ 


D. To implewent the training received (Question 9): 
23% indicated workshops needed. 
15% indicated consultant visits needed. 


BY indicated workshops and visits needed. 


PARTICIPANT COMMENTS 


s 


Participants indicated that the following were the most beneficial parts of this: session: 
-- the role-playing, (7 comments) 


. -+ learning to cop with problems encountered in ARD meetings (5‘comments). 
-- the prepared agenda (4 comments) 
-- the handouts (2 comments) % ‘ 


-- the problem-solving techniques (2 comments) 
-- opportunity to talk with other VACs (2 convhents) 


Participants made the following suggestions to improve «the workshop: ! 
--get more special education personnel involved in the workshop (2 comments) 
--schedule an activity after lunch to get everyone back into the spirit of the 

workshop (1 comment) 


| 
Participants indicated that they needed the following (1 comment each): . 
-- ARD/IEP workshop for Carrizo Springs high and jr. high schools 
-- ARD/IEP workshop for Judson ISD, 
-- written information to present to “principals and other administrators 
| -- inservice programs about ARD/IEP process for principals 
| -- vocational assessment for special education students 
! -- information on students eligible to be assessed at vocational assessment center 
| and how to refer students 
| -- more role-playing workshops 
| -- assistance to VACs in keeping up with current : yuidetenes 7 
-- provide an "ARD evaluator" to observe ARD meetings and make suggestions for 
improvement 


-- more inforiwation on audio-visual equipment 
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